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BACKGROUND 


In  the  present  paper,  a  hierarchy  of  functions  is  described  for  the  processing  of  visual 
motion  and  pattern  information  culminating  in  descriptive  sets  of  features.  Processing 
elements  that  model  simple  feature  detectors  respond  maximally  only  when  a  stimulus 
grating  pattern  with  a  specific  orientation  and  spatial  period  is  located  in  phase  with  the 
center  and  surround  of  the  element's  receptive  field.  Processing  elements  that  mtxlel 
complex  feature  detectors  respond  maximally  only  when  a  stimulus  grating  pattern  with  a 
specific  orientation  and  spatial  period  is  moved  in  a  specific  direction  through  the 
element’s  receptive  field. 

The  process  of  perception  in  biological  visual  sy.stems  involves  both  pattern  analysis  and 
pattern  synthesis.  Pattern  analysis  allows  the  discovery  of  distinguishing  sets  of  features 
of  input  patterns  that  are  useful  for  the  discrimination  of  likely  targets  required  for  some 
specific  behavioral  response.  Complex  .sets  of  features  may  be  required  to  discriminate 
targets  such  as  faces,  while  trigger  stimuli  that  release  sequences  of  species  specific 
behaviors  can  be  very  simple  features  such  as  size,  color,  or  motion  (Ewert.  1987). 
Pattern  synthesis  allows  prediction  and  selective  filtering  of  targets  from  a  complex  and 
dynamically  changing  environment. 

The  division  of  perceptual  processes  into  analysis  and  synthesis  is  somewhat  artificial 
and  done  so  for  the  convenience  of  modeling  and  discussion.  This  paper  focuses  on  the 
processes  of  motion  and  pattern  analysis  that  could  provide  the  basic  environmental 
information  to  a  perceiving  system.  For  an  introduction  to  a  complementary  approach  to 
the  problem  of  pattern  synthesis  and  prediction,  see  Blackburn  and  Nguyen  (1989)  and 
Blackburn  (1990). 

The  neurobiological  literature  clearly  indicates  that  feature  detection,  selective  filtering 
and  analysis  are  accomplished  by  using  functions  from  multiple  levels  of  the  visual 
system.  In  mammals,  much  preprocessing  of  the  visual  information  occurs  in  the  retina 
and  thalamus  before  it  reaches  the  visual  cortex  where  synthesis  and  recognition  take 
place.  It  could  be  useful,  in  terms  of  neural  modeling  and  the  simulation  of  advanced 
perceptual  processes,  to  provide  as  much  biological  fidelity  as  feasible  of  the  early  pattern 
analysis  in  the  retina,  thalamus  and  primary  visual  cortex  to  help  define  the  more 
advanced  perceptual  processing  algorithms.  It  is,  therefore,  the  purpose  of  this  resetvrch 
to  examine  methods  of  feature  detection  involving  models  of  the  motion  and  pattern 
analysis  processes  of  the  biological  retina,  thalamus,  and  primary  visual  cortex. 

An  additional  neural  structure,  the  superior  colliculus  (SC)  of  the  brain  stem  tegmentum, 
also  significantly  determines  the  information  available  to  the  visual  cortex.  The  SC, 
though  not  interposed  in  the  major  transmission  pathway  from  the  retina  to  the  cortex, 
determines  the  visual  input  to  the  cortex  tlirough  its  control  ot  saccadic  eye  movements. 
In  the  simulations  presented  below,  all  activity  patterns  are  presented  from  computations 
that  have  occurred  in  the  inter  saccade  intervals. 

A  schematic  of  the  components  of  the  mammalian  visual  system  considered  in  the  present 
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paper  is  given  in  figure  1.  The  components,  except  for  the  SC,  will  be  discussed  in  the 
following  sections.  For  a  description  of  the  model  of  the  SC  and  its  role  in  the  system,  see 
Blackburn  (1993b). 


ALGORITHM 

CENTER  SURROUND  RECEPTIVE  FIELDS 

Two  major  streams  of  visual  information  flow  from  the  retina  to  the  cortex.  These  focus 
on  the  analysis  of  motion  and  pattern  information  respectively  (Van  Essen  and  Maun.sell, 
1983).  Motion  information  is  thought  to  be  initiated  in  the  fast  conducting  transient  Y- 
type  retinal  ganglion  output  cells,  while  pattern  information  is  suggested  to  be  initiated  in 
the  slower  conducting,  sustained  X-type  retinal  ganglion  cells  (Stone  et  al.,  1979).  Pattern 
analysis  begins  in  the  outer  plexiform  layer  of  the  biological  retina  (Dowling,  1987).  In 
that  layer,  center  surround  receptive  fields  are  processed  to  provide  a  mechanism  of 
contrast  enhancement.  We  have  explicitly  modeled  this  mechanism  by  computing  the 
local  spatial  derivative  of  the  contrast  gradient  in  the  visual  input  (Blackburn.  1993a). 
Both  on-center/off-surround  and  off-center/on-surround  receptive  fields  are  organized, 
providing  effects  that  have  been  described  by  the  now  familiar  two-dimensional 
difference-of-Gaussians  (Rodieck,  1965).  Currently,  the  activities  of  the  bipolar 

elements^  are  passed  directly  to  ganglion  output  elements.  These  exist  as 
complementary  pairs  {RXOi ;  and  RXl^  d  covering  the  same  locations  in  the  visual 
field. 

LOG-POLAR  MAPPING 

The  output  of  the  patteni  processing  subnetwork  of  the  retina  is  passed  to  the  lateral 
geniculate  nucleus  (LGN)  of  the  thalamus.  The  mapping  of  the  retinal  output  to  the  LGN 
and  cortex  is  not  geometrically  isomorphic,  but  can  be  described  by  a  complex 
logarithmic  transformation  (Schwartz,  1980,  1984).  First  of  all,  receptors  residing  on  the 
right  half  of  the  retina  (figure  1)  receive  information  from  the  left  half  of  the  visual  field, 
and  the  output  ganglion  cells  project  to  the  right  hemisphere,  while  the  right  half  of  the 
visual  field  is  projected  to  the  left  hemisphere.  Thus,  the  visual  field,  and  the  retinal 
surface  are  essentially  split  down  the  vertical  raidline.  Secondly,  the  large  numbers  of 
fibers  leaving  the  foveal  region  (central  area)  of  the  retina  are  accompanied  by  a  much 
smaller  number  of  fibers  from  the  peripheiy  that  none-the-less  represent  a  much  larger 
region  of  the  visual  field.  The  physical  constraints  of  bundling  contributes  to  the  grouping 
of  p)eripheral  fibers  on  one  side  of  the  bundle,  because  they  are  displaced  by  the  large 
number  of  foveal  fibers  occupying  the  other  side. 


'Because  biological  terms  are  used  in  this  paper  to  identify  different  processing  structures  and  layers,  some 
confusion  is  possible  between  references  to  biological  data  and  model  constructions.  To  help  prevent  this  confusion, 
components  of  biological  structures  will  be  called  celh  and  componcnis  of  artificial  structures  will  be  called  elements 
^The  appendix  provides  a  list  of  symbols  and  abbreviations. 
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thalamus 


Figure  1.  Schematic  of  the  processing  stations  involved  in  early  vision.  Arrows  indicate  direction  of  information 
flow.  The  numbers  represent  mappings  of  retinal  locations  between  the  processing  stations.  The  thalamus, 
superior  colliculus,  and  visual  cortex  are  bilateral  structures,  divided  by  the  vertical  meridian.  The  small  circles 
on  the  receptor  surface  represent  receptive  fields  of  individual  ganglion  output  elements  showing  that  the 
receptive  fields  increase  in  size  with  distance  from  the  center.  Similar  fields  cover  the  entire  surface. 


The  use  of  log-polar  mapping  in  the  present  model  is  illustrated  in  figure  1.  The 
computational  details  of  this  mapping  can  be  found  in  Blackburn  {1993a).  The  net  result 
of  the  mapping  places  the  projections  from  the  central  region  of  the  receptor  surface  at 
one  end  of  the  primary  visual  cortex,  and  from  the  periphery  of  the  receptor  surface  at  the 
the  other  end.  Foveal  magnification  on  the  cortical  projection  is  a  consequence  of  this 
mapping  (Rolls  &  Cowey,  1970).  Only  radial  lines  on  the  receptor  surface  will  map  to 
vertical  lines  on  the  other  components,  while  only  concentric  arc  lines  on  the  receptor 
surface  will  map  to  horizontal  lines  on  the  other  components.  Thus,  short  venical  or 
horizontal  lines  located  off  the  vertical  or  horizontal  meridians  of  the  receptor  surface 
will  produce  a  variety  of  nonlinear  representations  on  the  other  maps. 

THALAMIC  LGN 

A  comprehensive  review  of  the  thalamic  lateral  geniculate  nucleus  is  available  in  Jones 
(1985)  from  which  the  following  relevant  details  were  extracted.  The  LGN  receives 
retinotopically  the  retinal  output,  and  saccade  information  from  the  SC.  The  retinotopic 
mapping  is  described  by  the  log-polar  transform  explained  above.  Neighborhood 
relationships  are  mainiainpd  hy  the  mapping.  The  LGN  forwards  processed  signals  to  the 
cortex.  The  LGN  is  divided  into  several  laminae,  each  receiving  predominantly  a 
different  type  of  ganglion  output  cell  from  the  retina.  The  receptive  fields  of  the  LGN 
principal  cells  are  similar  to  the  receptive  fields  of  the  retinal  ganglion  cells  from  which 
they  receive  input,  and  the  convergence  (or  divergence)  of  retinal  cells  upon  thalamic 
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relay  cells  is  quite  small. 


We  have  implemented  a  relatively  simple  network  for  LGN  processing.  I'he  connections 
for  the  off-center  X  pathway  are  shown  in  figure  2.  The  processing  in  the  principal 
elements  (TXO  and  7X7)  is  modulated  by  inhibitory  elements  dXO  and  JXl)  and 
suppressed  by  saccade  signals  from  the  SC  (Singer,  1977).  Principal  elements  maintain 
t‘i<*  same  receptive  fields  (0  =  off-center,  1  =  on-center)  a.s  the  retinal  ganglion  elements. 
If  the  potential  is  driven  negative,  as  occurs  following  a  saccade,  the  output  is  set  to  zero. 

The  potential  on  the  thalamic  principal  off-center  element  is  given  by 

TXOij  =  max  {0,  RXOi  j  -  IXO^  j  -  S}  ,  [  1  ] 

where  S  is  a  saccade  signal  from  the  superior  colliculus  and  is  set  to  half  the  maximal 
output  possible  from  a  thalamic  principal  element  when  the  SC  orders  a  saccade, 
otherwise  =  0. 

The  inhibitory  elements  attempts  to  follow  the  potential  arriving  from  the  retina  at  its 
principal  element.  In  addition,  potentials  are  distributed  laterally  within  the  inhibitory 
element  layer  just  as  they  are  done  in  the  horizontal  layer  of  the  retina  (Blackburn. 
1993a). 

The  off-center  inhibitory  element  input  buffer  (IXOb)  is  given  by 

=  Ki'tRXO,jf„  ■  IXOtjf,.,))  + 

)  ■  IXOij,,., ,) .  12) 

where  RXO  is  the  retinal  ganglion  element  output  potential,  IXO  is  the  equilibrated 
inhibitory  element  potential  from  the  previous  time  step,  k  and  /  define  the  six  nearest 
neighbors,  i  and  j  locate  the  receptive  field  center.  K j  and  ^2  are  constants;  in  the  present 

examples,  Xy  =  0.5  and  K2  =  0.5. 

The  sum  is  normalized  by  the  number  of  potentially  contributing  inputs.  Normalization  is 
accomplished  by  using  a  gain  factor  for  transmission  that  is  inversely  proportional  to  the 
number  of  inputs  to  an  element.  Biologically,  this  could  reflect  the  competition  for 
available  post  synaptic  space.  The  larger  the  number  of  inputs  from  different  sources,  the 
less  chance  that  any  one  source  could  command  a  sufficient  number  of  synaptic  sites  to 
have  a  big  effect. 
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Figure  2.  Model  of  the  on-center  pathway  in  the  thaJamic  LCN.  TXO  are  principal  X  type  relay  elements,  1X0 
are  their  inhibitory  elements.  Connections  hetwecn  lines  occur  only  at  "T"  junctions  in  the  drawing. 

In  one  time  step  (t),  the  potential  becomes  uniformly  distributed  in  each  inhibitory 
element: 


Similar  expressions  to  [1],  [2]  and  [3]  exist  for  on-center  elements  (TXl). 

The  dimensions  of  the  LGN  model  (and  of  the  cortex  model)  are  essentially  set  by  the 
retinal  projection.  In  the  current  implementation,  a  64  by  64  array  of  retinal  ganglion 
elements  project  to  the  LGN.  Near  the  center  of  the  retina,  there  are  more  ganglion 
elements  than  receptors.  Thus,  a  one  to  many  mapping  results.  A  consequence  of  this 
overrepresentation  of  the  retinal  center  is  a  redundant  mass  of  activity  initially  in  the 
central  region  of  the  projection  to  the  LGN.  However,  the  surround  inhibition  in  the  LGN 
rapidly  eliminates  this  redundant  activity,  and  only  the  unique  edges  of  activity  are 
passed  to  the  model  cortex. 

Figure  3  shows  the  pattern  induced  in  the  LGN  model  by  a  diagonal  line  of  one  pixel  in 
width  rotating  clockwise  5.6  degrees  per  program  cycle.  The  division  of  the  paitem  near 
the  central  projection  is  due  to  the  redundant  repre.sentation  with  surround  inhibition  that 
highlights  only  the  contrast  borders.  The  asymmetric  off-center  activity  seen  to  the  right 
of  the  on-center  activity  (centered  in  column  17  at  the  arrows)  is  due  to  the  motion  of  the 
pattern  to  the  left  on  the  LGN  matrix  and  the  delay  in  forming  and  inhibitory  suiTound  in 
the  outer  plexiform  layer  of  the  retina  (see  Blackburn,  1992a,  for  a  more  complete 
explanation).  While  the  original  image  width  was  only  one  pixel,  the  broadening  of  the 
pattern  in  the  LGN  is  due  to  the  overlap  of  receptive  fields  in  the  retina. 
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Figure  3.  Activity  pattern  in  the  thalamic  LGN  model  induced  by  a  diagonal  line  of  one  pixel  in  width  rotating 
clockwise  5.6  degrees  per  program  cycle  on  the  surface  of  the  retinal  model.  The  activity  pattern  is  moving  to 
the  left  in  the  LGN.  The  left  and  right  bilateral  LGN  have  been  placed  together.  Active  on-center  elements  (with 
potentials  that  are  greater  than  zero)  are  shown  in  (a)  with  an  asterisk,  and  off-center  elements  are  shown 
similarly  in  (b).  Column  17  is  indicated  in  (a)  and  (b)  with  arrows. 


Processing  differs  in  the  LGN  model  from  the  retinal  model  in  two  important  respects: 
(1)  the  thalamic  inhibitory  element  is  specific  to  each  principal  relay  element,  and  (2) 
there  is  a  one-to-one  relationship  between  input  and  ouif  ut  elements  in  the  LGN  across 
the  projection  field.  There  is,  thus,  one  inhibitory  element  for  an  on-cenier  element  and  a 
different  inhibitory  element  for  an  off-center  element.. 

The  principal  elements  of  the  Y  pathway  of  the  LGN  (7Y0  and  7T7)  currently  accept  the 
output  from  the  motion  processing  subnetwork  of  the  retina  (RYO  and  RV)  and  are 
computed  in  similar  fashion  to  the  TXO  and  TXJ  elements. 

PRIMARY  VISUAL  CORTEX 

In  the  mammalian  primary  visual  cortex,  feature  detectors  have  been  discovered  for  line 
orientation,  stimulus  length  and  width,  movement  velocity  and  direction,  spatial 
frequency,  position  disparity,  and  orientation  disparity  (Orban  ,1984). 
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Feature  detectors  for  lines  or  edges  were  divided  into  simple  complex  and  hypercomplex 
types  by  Hubei  and  Wiesel  (1962,  1977).  According  to  their  original  definitions,  simple 
feature  detector  cells  respond  maximally  to  a  line  with  a  specific  orientation  and  location 
in  a  very  circumscribed  region  of  the  visual  field.  The  complex  fcai'ire  detector  cells 
respond  to  a  line  of  specific  orientation  but  allow  a  larger  region  of  the  visual  space.  The 
complex  cells  do  not  permit  the  width  of  the  stimulus  line  to  increase  propoitionately. 
Hypercomplex  cells  are  similar  to  complex  cells  except  that  they  can  be  inhibited  by 
extending  the  length  of  the  line  beyond  the  excitatory  receptive  field. 

Definitions  of  simple  and  complex  cells  were  modified  when  more  complex  stimuli  were 
used  to  test  the  cells  receptive  field  characteristics.  Dnfting  sinusoidal  or  stjuare  wave 
gratings  were  used  to  stimulate  the  entire  receptive  field  of  a  cortical  cel!  at  one  time. 
Simple  feature  detectors  were  then  defined  as  cells  that  responded  in  a  linear  fashion 
(defined  by  the  temporal  modulation  of  the  cell’s  firing  rate  by  the  rate  of  drift  of  the 
grating  interacting  with  its  spatial  frequency)  to  a  sinusoidal  grating  with  a  spatial 
periodicity  that  matched  the  periodicity  of  the  center  and  the  sunounci  of  the  cell's 
receptive  field.  Complex  feature  detectors  were  cells  that  respondet!  in  a  nonlinear 
fashion  (Maffei  and  Fiorentlni,  1973).  The  .stimulus  conditions  associated  with  the 
maximal  firing  rate  of  the  cell  defined  the  cell's  preferred  orientation  and  spatial 
frequency. 

"Within  a  few  degrees  of  the  visual  field  center,  the  receptive  fields  of  cortic.  1  cells 
approximate  the  receptive  fields  of  single  retinal  ganglion  cells  except  that  they  are  more 
sharply  tuned  for  spatial  frequency  (Maffei  and  Fiorentini,  1973).  When  a  stimulus 
grating  pattern  is  in  phase  with  retinal  ganglion  cell’s  receptive  field,  the  cell  will  respond 
maximally,  but  when  the  pattern  is  180  degrees  out  of  phase,  the  retinal  ganglion  cell’s 
activity  will  be  suppressed.  Because  the  sinusoidal  grating  covered  the  entire  receptive 
field  of  a  cell,  a  linear  response  indicated  an  integration  of  a  single  pair  (tir  several  pairs 
of  nonoverlapping)  inhibitory  and  excitatory  zones,  while  a  nonlinear  response  indicated 
an  integration  of  multiple  overlapping  inhibitory  and  excitatory  zones  (a  laterally  drifting 
grating  across  the  receptive  field  of  a  complex  element  cc  ’ild  generate  a  continuous 
response).  The  size  of  the  inhibitory  and  excitatory  zones  contributed  to  the  preferred 
spatial  frequency  of  the  simple  or  complex  cell.  If  the  grating  frequency  was  greater  than 
the  widtn  of  the  zones,  then  both  zones  would  be  coactivated  by  a  siationaiy  or  dnfting 
grating  regardless  of  phase  and  the  cells  response  would  be  reduced.  Low'  spatial 
frequencies  of  square  wave  gratings  could  also  coactivate  both  zones,  but  would  appear  to 
the  cell  as  an  edge,  or  border  between  bright  and  dark  regions,  moving  across  the  field. 
The  distinct  classification  of  hypercomplex  cells  has  lost  favor  due  to  the  observ'ation  that 
both  simple  and  complex  cells  can  show  end-stop  inhibition  (Dreher,  1972;  Oi'ban,  1984). 
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Motion  Selectivity 


Many  simple  and  complex  cells  showed  a  preference  for  the  direction  of  drift  of  the 
oriented  line  or  grating.  The  prefeiTed  direction  was  always  onhogonal  to  the  preferred 
line  orientation  (Schiller  et  al.,  1976).  In  addition,  some  complex  cells  respond 
preferentially  to  stimulus  velocity,  that  is  -  a  stimulus  moving  in  a  panicular  direction 
with  a  particular  speed  (Sekuler  et  al.,  1990).  Simple  cells  do  not  generally  have  velocity 
sensitivity,  except  that  they  respond  best  to  slowly  moving  stimuli  ( Maffei  and  Fnorentini. 
1973).  The  rather  complete  dependence  of  simple  cells  on  input  from  the  X  pathway, 
which  is  a  low  pass  system,  may  account  for  their  inability  to  respond  to  high  stimulus 
velocities.  The  complex  cells,  on  the  other  hand,  receive  input  also  from  the  Y  pathway  , 
which  is  a  high  pass  .system  and  may  give  the  complex  cells  the  capability  to  respond  to 
faster  moving  events. 

Direction  of  Contrast  Independence 

At  some  point  in  image  proce.ssing,  a  line  must  have  an  effect  that  is  independent  of 
whether  it  is  a  bright  line  on  a  dark  background,  ora  dark  line  on  a  bright  background.  At 
that  point,  the  "lineness"  of  the  feature  is  direction-of-contrast  independent.  While  a 
common  house  fly  prefers  a  dark  target  on  a  bright  background  (Wehner,  1981 ).  humans 
have  little  difficulty  reading  bright  text  on  a  dark  background,  nor  the  reverse,  thus 
demon,strating  direction-of-contrast  independence. 

There  is  evidence  for  the  early  confluence  of  on-center  and  off-center  activity  in  the 
primary  visual  conex.  Bishop  et  al.  (1971)  reponed  that  a  majority  of  line  oriented  simple 
cells  responded  to  both  edges  of  a  moving  narrow  bar  of  light  on  a  dark  background. 
Schiller  (1982)  found  that  chemical  bkKiking  of  the  retinal  on-center  mechanisms 
eliminated  the  light-edge  response  of  conical  cells  but  "had  no  discernible  effect  on 
orientation  and  direction  specificities".  Their  data  indicated  that  both  on-center  and  off- 
center  activity  converge  on  the  same  line  orientation  detectors.  A  similar  finding  was 
reponed  by  Sherk  and  Honon  { 1984). 

The  early  confluence  of  on-center  and  off-center  activity  would  save  duplicate  proce.ssing 
at  later  stages  and  allow  for  the  general  definition.s  of  features  independent  of  its  contrast 
relationship  to  the  background.  In  the  current  implementation  (figures  4  to  6).  a  direction- 
of-contrast  independence  of  the  oriented  line  detectors  is  achieved  by  the  projection  of 
both  on  and  off-center  thalamic  elements  with  the  same  receptive  fields  to  the  same 
cortical  elements  . 

Line  Orientation  Selectivity 

The  pioce.ss  actually  stans  in  the  interaction  of  receptors,  horizontals,  and  bipolm-.s  in  the 
retina.  Only  one  of  a  complement  pair  of  on-center  and  off-center  bipolars  that  have  the 
same  receptive  field  center  can  be  active  at  any  moment,  yet  the  suiTounding 
neighborhood  of  an  active  bipolar  of  one  type  is  u.sual]y  compo.sed  of  active  bipolars  of 
the  other  type.  Therefore,  when  the  cortical  input  layer  elements  receive  a  fuzzy  (slightly 
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defocussed)  distribution  of  on-center  and  off-center  activity  trom  the  retina,  the 
neighboring  projections  of  contrasting  types  can  reinforce  the  pattern  center. 

Thaltiniic  input  to  the  conex  is  distributed  primarily  to  stellate  ceils  in  layers  4A  and  4C. 
The  slower  conducting,  sustained  X-type  activity  is  projected  to  cortical  lasers  4 A  and 
4Cp,  while  the  faster  conducting,  iran.sient  Y-type  activity  is  projected  to  conical  layer 
4Ca.  Layer  4C  ceils  then  project  to  other  cortical  layers.  There  is  ample  evidence  that 
the  other  cortical  layers  receive  direct  input  from  the  LGN  as  well.  In  the  present  paper, 
we  have  identified  processing  elements  by  using  labels  taken  from  the  cortical  layers  in 
which  we  speculate  that  the  modeled  biological  activity  takes  place. 

In  order  tc  be  consistent  with  the  finding  of  Creiitzfeldt  and  Ito  ( 1968)  that  the  excitatory 
receptive  fields  of  conical  elements  are  circular,  we  distributed  the  thalamic  input  locally 
in  a  small  field  about  each  target  cortical  element.  In  this  way,  each  conical  element 
receives  excitatory  input  from  a  similar  number  of  on-center  and  off-center  thalamic 
elements  covering  the  same  ’■eceptive  fields  (figures  4  and  5).  Neighboring  cortical 
elements  receive  similar  thalamic  input  offset  by  one  thalamic  receptive  field  from  the 
next.  This  divergence  and  overlap  in  the  projection  defocusses  or  fuzzifies  the  image,  but 
allows  for  the  definition  of  oriented  line  segments  of  length  equal  to  the  degree  of 
fuzziness.  A  longer  radius  of  integration  would  increase  fuzziness  of  the  projection  and 
increase  the  potential  line  orientation  resolution. 

Because  intracortical  inhibition  has  been  shown  to  participate  in  the  definition  of 
orientation  sensitivity  (Sillito  et  al.,  1980),  we  used  inhibition  to  shape  the  directional 
sensitivities  of  the  cortical  elements  similar  to  the  proposal  of  Heggelund  (1981 ). 
Additionally.  Mat.subara  et  al.  (1985)  found  that  simple  cells  formed  inhibitory 
connections  preferentially  between  detectors  with  orthogonal  orientations. 

The  4C^  elements  and  the  4B  line  orientation  detector  elements  receive,  with  a  small 
convergence  equal  to  the  divergence  of  the  thalamic  input,  excitatory  direct  input  from 
thalamic  elements  (figure  4).  The  4B  elements  then  receive  indirect  thalamic  inhibition 
via  the  4CP  elements  from  a  specific  region  of  their  surround.  The  extent  of  the 
inhibition  in  one  direction  is  set  at  twice  the  radius  of  the  integrated  input  from  the 
thalamus.  Each  4B  element  receives  inhibition  from  4CP  elements  only  along  one 
diameter  (figure  5).  The  directionally  oriented  inhibition  could  be  accomplished  in  natural 
systems  by  a  linear  arborization  of  the  4B  cell’s  basal  dendrites  (Tieman  and  Hirsch. 
1982),  or  by  horizontally  aligned  stellate  intemeurons  (Braak,  1980).  The  result  of  the 
linear  accumulation  of  inhibition  from  the  4C3  elements  is  an  orientation  preference  in 
the  4B  element  that  is  normal  to  its  inhibitory  input.  In  addition,  the  4B  oriented  feature 
detector  receives  inhibitory  input  from  another  detector  that  has  the  same  receptive  ficki 
but  has  an  orientation  preference  normal  to  its  own  orientation  preference  (figure  6).  ITie 
output  of  the  4B  feature  detector  is  half-wave  rectified,  passing  only  positive  activity. 
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Figure  4.  Confluence  of  pairs  of  off-center  and  on-center  thabmic  input  and  their  dLstributiun  to  layer  4Cb 
elements.  The  distribution  pattern  occurs  over  two  dimensions,  though  only  one  dimension  is  shown  in  the 
figure.  A  similar  distribution  of  thalamic  X  activity  is  also  made  to  layer  4B  elements. 


In  the  present  model,  it  is  thus  the  direction  of  the  lateral  spread  of  inhibition  that  defines 
the  preferred  orientation  tuning  of  the  cortical  element,  and  not  any  specificity  in  the 
thalamic  projection  as  was  suggested  by  Hubei  and  Wiesel  (1972).  Lateral  inhibition  that 
defines  the  line  orientation  also  remove.s  the  fuzziness  due  to  the  defocussed  thalamic 
projection. 

The  input  to  the  layer -/CP  element  is  given  by 

141 

where  k  and  /  index  the  convergence  of  thalamic  input  to  the  layer  4CP  element  and  a  = 

(k*k  +  1*1)'^^^  .  Currently,  the  degree  of  convergence  (and  divergence)  of  thalamic  input 
to  layer  4CP  is  9  to  1.  That  is,  a  layer  4C^  element  collects  input  from  thalamic 
projections  that  map  within  a  distance  of  +/-  1  element  from  its  center.  This  degree  of 
convergence  could  be  increased  in  a  system  with  higher  resolution  (a  large’-  number  of 
receptive  fields  with  relatively  smaller  receptive  field  sizes). 


4Bh 

Figures.  Orientation  of  inhibitory  input  to  layer  .simple  feature  detectors  (shown  in  two  dimensions).  The 
detectors  arc  labeled  by  their  orientation  sensitivities  rather  than  the  orienbtion  of  the  inhibition  that  they 
receive.  The  four  orientation  detectors  showu  have  receptive  field  centers  essentially  in  the  same  location  on  the 
receptor  surtacc. 
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The  potential  on  the  oriented  detectors  in  kxytr  4B  is  set  as 


4Bhij(^)  =  max  {0.  ^  i-,kj^lht) ' 

4B(f^j(j)  =  max  {0,  ^  ^*^^^i+kj+l  ^h-^-k.j+lHt) ' 

^*(™i+kj+l  +  T^U+kJ+ldt)  - 

^'^*'^m  ijd'l 


where 7=  X,  k  and  /  are  defined  as  in  [4];  m  -  2*X  is  the  distance  over  which 

inhibition  is  integrated;  and  h  identifies  the  horizontal  orientation  preference,  v  the 

vertical  orientation  preference,  and  and  d'  the  diagonal  orientation  preferences  relative 
to  the  surface  of  the  cortical  map. 


Figure  6.  One-dimensional  horizontal  distribution  of  inhibition  from  4Ch  elements  to  4Bv  elements  that 
contribute  to  their  sensitivity  to  vertical  lines.  Feedback  inhibition  from  horizontal  line  detectors  (4B/i)  that  have 
received  inhibition  only  along  the  vertical  aids  completes  the  process.  When  a  horizontal  line  is  present  in  the 
input,  both  4Bv  and  4Bh  detectors  receive  the  same  amount  of  excitation  from  the  thalamus  but  the  greater 
inhibition  from  the  series  of  4Cb  elements  along  the  projection  of  the  horizontal  line  stimulus  onto  the  4Iiv 
elements  allow  the  4B/j  detectors  to  overpower  the  complementary  4Bv  detectors  and  represent  the  stimulus 
feature. 
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The  activity  patterns  produced  in  the  layer  4B  line  orientation  detectors  by  the  pattern  of 
activity  shown  for  the  LGN  in  figure  3  are  given  in  figures  7  a-d.  Since  the  LGN’  is 
forwarding  essentially  a  pair  of  vertical  lines  to  the  conex,  the  4Bv  detectors  in  the 
majority  represent  the  pattern.  In  the  central  projection,  how'ever.  the  line  branches  in  a 
"Y"  formation,  thus  evoking  activity  in  the  diagonal  line  detectors.  Only  sporadic  activity 
in  the  horizontal  detectors  is  seen. 

Sectorization  of  the  Cortex 

The  model  conical  surface  is  organized  into  overlapping  sectors  (figure  8)  that  roughly 
model  the  concept  of  the  hypercolumn.  In  the  present  version,  each  sector  is  composed  of 
8*8  individual  receptive  fields.  The  sectors  overlap  their  neighbors  by  25%.  Motion  is 
analyzed  independently  in  each  of  the  overlapping  sectors.  The  direction  of  motion  on  the 
horizontal  or  vertical  surface  of  the  cortex  is  determined.  The  motion  information  is  used 
to  determine  activations  of  direction  selective  complex  elements. 

Motion  Analysis  In  The  Cortex 

The  method  of  motion  analysis  that  we  use  is  that  of  feed-forward  lateral  inhibition 
(Blackburn  et  al.,  1987).  In  Blackburn  et  al.  (1987),  motion  was  analyzed  in  the  inner 
plexifoma  layer  of  the  retina  model.  In  the  present  implementation,  the  essentials  of  the 
earlier  motion  analysis  are  maintained  but  the  site  of  the  processing  has  been  moved 
centrally  to  layers  4Ca  and5A  of  the  cortex.  The  input  from  the  Y  pathway  of  the  LGN 
is  distributed  to  four  sheets  of  elements  in  layer  4Ca  in  such  a  way  that  the  activity  is 
slightly  offset  laterally  from  a  direct  topographic  mapping  of  the  input.  The  4Ca  elements 
then  inhibit  the  underlying  pyramidal  elements  in  layer  5A.  For  a  receptive  field  of 
arbitrary  size,  we  have  found  it  practical  to  assign  only  four  directionally  sensitive 
pyramidal  elements  in  each  sector,  each  one  sensitive  to  movement  in  one  of  the  four 
cardinal  directions  relative  to  the  cortical  surface.  Each  of  the  four  sheets  of 
4Caelements  receives  input  from  a  different  cardinal  direction.  Movement  of  a  spot  of 
light  on  the  receptor  surface  will  produce  before  it,  on  one  or  another  4Ca  sheet,  a 
moving  spot  of  inhibition  that  opposes  conduction  of  the  4Ca  potential  to  the 
directionally  sensitive  pyramidal  element  in  layer  5A.  This  defines  the  null  response 
direction  of  movement  in  the  receptive  field  for  that  pyramidal  element.  Diagonal  motion 
on  the  cortical  surface  is  measured  by  the  joint  activity  of  orthogonal  pairs  of  the  four 
cardinal  direction  motion  detectors. 
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Figure  7.  Responses  of  simple  line  orientation  detectors  to  input  from  the  LGN  pattern  represented  in  figure 
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left  projection  right  projection 


Figure  8.  Sectorization  of  the  cortical  plane.  The  plane  is  first  divided  down  the  vertical  midlinc  (arrow),  The 
left  half  of  the  cortical  plane  receives  projections  from  the  left  half  of  the  receptor  surface  (via  the  thalamic 
LGN),  and  the  right  cortical  plane  receives  projections  from  the  right  half  of  the  receptor  surface.  There  are  53 
sectors  on  each  side,  each  the  size  of  the  medium  line  density  squares,  and  each  overlapping  each  of  its  neighbors 
by  25%  (the  size  of  the  smallest  squares). 

Complex  Elements 

Complex  elemenis  are  subject  to  line  orientation,  spatial  period,  and  direction  of  motion. 
We  insure  that  motion  information  is  available  locally  from  the  LGN  Y  pathway, 
analyzed  between  layers  4Ca  and  5A.  The  diameters  of  the  receptive  fields  of  the  Y 
retinal  ganglion  cells  are  approximately  3  times  larger  than  the  diameters  of  X  retinal 
ganglion  cells  at  all  eccentricities  (Perry,  Oehler,  and  Cowey,  1984).  While  the  receptive 
field  sizes  of  our  model  Y  and  X  retinal  elements  are  the  same,  we  have,  for  convenience, 
integrated  Y  element  output  in  8  by  8  element  sectors  that  approximate  the  larger 
receptive  fields  of  Y  ganglion  cells.  Motion  from  the  retinal  Y  elements  and  spatial 
periodicity  of  X  element  activity  is  computed  over  the  size  of  the  integrated  Y  element 
sectors.  The  range  and  resolution  of  the  spatial  periods  that  can  be  discriminated  within  a 
.sector  are  limited  by  the  size  of  the  receptive  fields  and  their  number  within  the  sector. 
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In  the  present  implementation  of  complex  elements,  the  input  from  the  simple  detectors 
of  layer  46,  with  a  short  delay,  determines  the  sensitivity  to  line  orientation  and  spatial 
period.  Direction  specificity  of  the  3B  element  is  due  to  a  gating  input  from  SA.  if  motion 
in  a  particular  direction  is  indicated,  and  if  there  is  activity  from  a  feature  detector  located 
in  the  direction  of  the  origin  of  the  motion,  then  the  activation  (if  any)  of  a  like  type 
feature  detector  located  at  a  given  distance  (the  spatial  period  sensitivity)  in  the  direction 
of  motion  is  passed  to  the  complex  element.  The  circuit  diagram  for  the  input  to  a 
complex  element  with  sensitivity  to  spatial  periods  of  two  receptive  fields,  with  a 
horizontal  orientation,  and  with  a  movement  preference  to  the  left,  is  given  in  figure  9. 


Figure  9.  The  layer  3B  complcr  element  is  selective  la  orientation  by  virtue  of  its  input  from  an  orientation 
selective  clement  in  layer  4B,  to  direction  of  motion  due  to  the  gating  action  of  a  directionally  selective  clement  in 
layer  SA,  and  to  spatial  period  due  to  the  feed  forward  lateral  facilitation  of  layer  48  elements  with  a  given  delay 
(distance)  before  termination  upon  the  38  element.  Increased  periods  arc  achieved  by  increased  delays. 


Complex  elements  are  designed  to  respond  preferentially  to  directed  motion  orthogonal  to 
their  preferred  line  orientation.  Since  we  have  simple  elements  that  respond  preferentially 
to  four  different  orientations  (two  diagonals,  the  vertical  and  horizontal),  we  can  construct 
complex  elements  with  eight  different  combinations  of  direction  and  orientation 
preference.  The  size  of  the  sectors  determines  the  degree  of  location  uncertainty  of  events 
within  a  sector.  The  spatial  frequencies  available  for  analysis  are  determined  by  the 
lateral  offset  of  the  46  contributions.  We  have  limited  these  to  origins  within  neighboring 
sectors. 

Within  each  .sector,  the  orientation  and  direction  of  motion  selectivity  are  accomplished 
by  combining  in  a  logical  ’and’  element,  activities  from  oriented  simple  line  detectors 
and  motion  detectors  with  direction  preferences  orthogonal  to  the  line  orientation.  When 
the  ’and’  element  becomes  active,  activity  from  a  line  detector  with  the  same  orientation 
and  with  a  specific  spatial  offset  from  the  former  line  detector  in  the  direction  of  motion 
is  pa.s.sed  to  the  complex  element.  All  such  pairs  with  the  same  spatial  period  selectivity 
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are  summed  within  a  sector.  When  the  dimensions  of  the  sector’s  receptive  field  is  8*8. 
the  complex  elements  are  selective  for  spatial  periods  or  offsets  of  2,3,4  and  5  simple 
detector  elements.  The  potential  on  a  complex  element  is  given  by 

=  Ip  J-kit- 1  )> 

~  ^-p  /  5Acl^ i_j 

/  5Au(fj  &  p,  [6] 

where  k  indexes  the  offset  that  defines  the  spatial  period;  p  represents  the  number  of  pairs 
of  oriented  detectors  /:  receptive  fields  apan  within  the  sector;  r  is  a  right  motion  detector, 
/is  a  left  motion  detector,  f/ is  a  down  motion  detector,  u  is  an  up  motion  detector;  v  is  a 
vertical  orientation  detector,  h  is  an  horizontal  motion  detector. 

Diagonal  complex  elements  (SBruj^,  3Bldj^.  3Brdj^,  3Bluj^)  are  computed  similarly  except 

that  the  direction  of  motion  is  determined  by  two  5A  elements,  and  the  search  vector  is 
determined  by  adjustments  to  both  i  and  j  indices. 


3Bruf^^t}  = 

Ip  ('^Bd' i  5Ar^f^  &  5Au^j'^  &  4Bd  i+fcj-^-k(t-l p- 

[7] 


BEHAVIOR 


The  responses  of  elements  within  the  system  were  tested  by  using  stimulus  grating 
patterns  of  different  spatial  frequency  that  were  drifted  across  the  entire  visual  field. 
Figures  10  (a)  and  (b)  show  the  activity  patterns  in  the  on-center  and  off  -center  principal 
elements  of  the  model  LGN  to  a  square  wave  grating  pattern  with  a  period  of  15  pixels. 
The  rate  of  drift  was  one  pixel  per  program  cycle.  Nonzero  activity  is  indicated  in  the 
figures  by  an  asterisk.  The  effects  of  the  log-polar  mapping  are  evident  in  the  nonlinear 
projection  of  the  regular  grid  pattern  to  the  thalamic  matrices.  Differences  between  the 
patterns  of  activity  that  developed  in  the  LGN  of  figure  10  are  due  to  the  phase  difference 
of  the  grid  lying  on  the  two  herairetinae.  The  absence  of  a  pattern  in  the  far  peripheral 
projection  is  due  to  the  large  receptive  fields  relative  to  the  size  of  the  grid  and  the  effects 
of  surround  inhibition.  The  central  projection  also  fails  to  respond  to  the  grid,  but 
because  the  grid  lines  are  too  thick  to  generate  any  contrast  between  the  center  and  the 
surrounding  receptive  fields.  However,  the  off-center  elements  do  respond  to  the  advance 
of  the  dark  edge. 
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Figure  10.  Projection  of  a  grating  pattern  upon  the  LGN  model. 


Figures  1 1  (a-d)  show  the  activity  patterns  of  the  four  different  types  of  simple  feature 
detectors  of  the  model  cortical  layer  4B  in  response  to  the  patterns  of  activity  in  the  LGN 
of  figure  10.  It  can  be  seen  that  while  the  detectors  respond  locally  to  the  orientation  of 
their  input,  they  also  respond  as  a  group  of  like  type  to  represent  the  global  features  of  the 
thalamic  pattern. 

The  activity  profiles  of  representative  layer  3B  elements  taken  from  different  sectors 
during  tests  with  different  grid  spatial  frequencies  are  given  in  figure  12.  The  sampled 
elements  were  always  the  detectors  for  the  lowest  spatial  frequency  in  each  sector  (5 
overlapping  receptive  fields).  These  profiles  are  similar  to  those  recorded  from  biological 
complex  cells  in  that  activity  was  decreased  by  greater  than  50%  for  each  octave  change 
in  spatial  frequency  (Maffei  and  Fiorentini,  1973).  Elements  located  in  sectors  that 
received  the  peripheral  projection  were  more  responsive  to  grating  patterns  with  lower 
spatial  frequencies.  High  spatial  frequency  gratings  did  not  activate  the  complex  elements 
in  the  peripheral  projection  due  to  their  absence  in  the  thalamic  projection  (figure  10). 
The  opposite  was  true  for  elements  receiving  the  central  projection.  This  sensitivity  is 
directly  a  function  of  the  receptive  field  sizes  of  the  X  retinal  ganglion  elements  because 
all  sectors  of  the  cortex  model  were  processed  identically. 
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(c)  (d) 

Figure  11.  Activity  patterns  in  layers  of  simple  feature  detectors  responding  to  input  from  the  pattern  present  in 
the  LGN  of  figure  10:  vertical  line  detectors  (a),  horizontal  line  detectors  (b),  diagonal  line  detectors  for  -45 
degrees  (c),  and  for  •(•45  degrees  (d). 
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Figure  12.  Activity  profiles  of  complex  elements  taken  firom  locations  that  receive  projections  with  increasing 
eccentricity  (a-g).  Note  that  the  spatial  period  scale  is  nonlinear. 


The  activity  profiles  of  figure  13  show  that  sampling  within  a  sector  while  changing  the 
spatial  frequency  of  the  grating  pattern  also  resulted  in  the  discrimination  of  the  pattern 
by  differently  tuned  detectors,  though  sensitivities  varied  over  a  much  smaller  range  than 
was  the  case  between  sectors.  The  differences  in  tuning  of  the  spatial  frequency  detectors 
within  sectors  was  due  to  the  connectivity  patterns  that  passed  lateral  facilitation  over 
different  distances  (figure  9). 


Figure  13.  Activity  profiles  of  three  complex  elements  located  in  the  same  paracentral  sector  and  representing 
the  same  orientation  and  direction  selectivities  but  with  increasing  spatial  period  sensitivities  from  a  to  c. 
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DISCUSSION 


The  dependence  of  orientation  preference  in  simple  line  detector  elements  on  a  dendritic- 
field  bias  has  received  checkered  confirmation  in  the  literature.  Tieman  and  Hirsch 
(1982)  found  that  kittens  deprived  of  lines  of  panicular  orientations  developed  abnormal 
distributions  of  dendritic  field  orientations.  Interestingly,  the  abnormalities  were  in 
orientations  of  fields  that  were  orthogonal  to  the  expected  projections  of  the  missing 
stimulus  orientations  -  a  finding  compatible  with  the  mechanisms  employed  in  the  present 
application.  However,  Martin  and  Whitteridge  (1984),  while  able  to  measure  a  dendritic 
bias  in  all  cells  studied,  found  no  consistent  relationship  between  the  dendritic  field  bias 
and  line  orientation  preference.  The  negative  results  of  Martin  and  Whitteridge  (1984) 
could  have  been  due  to  their  sampling  from  several  types  of  neurons  from  cortical  layers 
n  through  VI,  whereas  the  positive  results  of  Tieman  and  Hirsch  (1982)  could  have  been 
related  to  their  limited  sampling  of  pyramidal  cells  in  layer  III.  No  such  distribution 
abnormalities  were  seen  in  layer  IV  stellates  taken  from  the  same  preparations.  Both 
studies  faced  the  same  problem  of  estimating  the  projection  pattern  of  the  thalamic  input, 
which  due  to  the  log-polar  mapping,  is  not  straight  forward  and  could  complicate  efforts 
to  find  correlations  with  dendritic  field  orientations. 

As  an  alternative  to  the  use  of  oriented  dendritic  fields  for  the  organization  of  orientation 
sensitivity,  Vidyasagar  (1987)  argued  that  slight  asymmetries  in  the  LGN  responses  to 
oriented  stimulus  grids  of  different  spatial  frequency  could  contribute  to  the  sharp 
orientation  tuning  of  cortical  simple  elements  if  LGN  elements  with  orthogonally 
asymmetric  responses  would  converge  in  parallel  to  a  pair  of  conical  elements,  one  of 
which  was  inhibitory.  In  order  to  implement  a  Vidyasagar  model,  we  would  have  to 
account  for  the  response  asymmetries  in  the  LGN  or  retina,  and  provide  a  way  to  match 
orthogonal  asymmetries  in  the  input  to  cortical  elements  and  their  associated  inhibitory 
intemeurons.  There  is  also  a  question  of  whether  the  asymmetries  in  receptive  fields  from 
the  thalamus  could  provide  a  complete  and  systematic  representation  of  orientations 
within  each  region  of  the  visual  field. 

The  early  convergence  of  on-center  and  off-center  activity  upon  the  simple  feature 
detectors  would  appear  to  be  at  odds  with  the  observation  that  some  simple  cells  have 
di.stinct  center-surround  inceptive  fields  (Movshon  et  al,  1978),  but  other  papers  indicate 
that  many  simple  cells  receive  both  on-center  and  off-center  thalamic  input  (Bullier  ei  al., 
1982;  Orban,  1984).  The  present  model  will  produce  the  inhibitory  effects  of  the 
surround  by  lateral  inhibition  at  three  levels.  First,  a  broadening  of  illumination  (or  of 
darkness)  will  reduce  the  output  of  the  retinal  ganglion  elements.  Second,  the  surround 
inhibition  of  the  thalamic  LGN  attempts  to  further  sharpen  the  contrast  region.  Third,  the 
mutual  inhibition  between  orthogonal  line  detectors  in  the  cortex  will  reduce  the  response 
of  a  line  detector  if  activity  is  increased  on  its  sides.  Simple  feature  detectors  of  the 
present  model,  however,  do  not  respond  differently  to  a  bright  line  that  is  later  replaced 
exactly  by  a  dark  line. 

In  the  monkey,  radial  and  tangential  orientations  (relative  to  the  foveal  center) 
predominate  (Bauer  and  Dow,  1989).  Because  of  the  log-polar  mapping  of  retinal  output 
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to  the  cortex,  longitudinally  oriented  activity  on  the  cortex  translates  to  radially  oriented 
activity  on  the  retina,  while  latitudinally  oriented  activity  on  the  cortex  translates  to 
tangentially  or  concentrically  oriented  retinal  activity.  This  greatly  simplifies  the  local 
computations  required  in  the  cortex  model  to  produce  these  radial  and  concentric 
orientations  relative  to  the  visual  field,  for  the  integrations  can  be  performed  either  in 
parallel  or  in  orthogonal  directions  across  the  cortical  surface. 

A  non-parallel  distribution  of  radial  dendritic  fields  (relative  to  the  cell  body)  would 
provide  for  a  variety  of  orientation  sensitivities  that  have  been  described  by  Hubei  and 
Wiesel  (1972)  and  others.  The  systematic  shift  in  orientation  sensitivity  found  with  an 
electrode  probing  tangentially  to  the  conical  surface  could  be  a  function  of  the  realities  of 
packing  densities.  The  dendritic  proces.ses  of  several  cells  cannot  occupy  exactly  the 
same  space  in  the  plexus,  yet  the  proximity  of  their  cell  bodies  allows  them  to  share 
similar  receptive  fields  and  to  send  their  dendrites  into  neighboring  space,  offset  by  the 
few  degrees  width  of  the  radial  dendritic  field. 

The  meaning  of  activity  in  a  complex  element  can  be  deduced  from  the  several  factors 
that  contribute  to  that  activity.  These  factors  are  directional  movement  and  spatially 
distributed  line  features  oriented  orthogonal  to  the  direction  of  movement.  Thus,  an  active 
complex  element  indicates  that  some  line  segments  with  a  particular  spatial  separation  are 
moving  together  in  a  direction  orthogonal  to  their  orientation,  that  is,  complex  elements 
indicate  the  motion  of  a  bar  of  some  width.  The  temporal  delay  in  transmission  from  the 
facilitating  4B  element  to  the  SB  element  is  currently  independent  of  distance  or  spatial 
period.  This  can  yield  a  type  of  velocity  detector  for  a  single  oriented  line  moving  with 
sufficient  speed  to  activate  both  4B  elements  of  a  pair  within  the  sort  period  of  the  delay. 
Complex  elements  that  are  sensitive  to  greater  spatial  periods  would  also  be  sensitive  to 
greater  stimulus  velocities.  If  biological  complex  cells  processed  information  similar  to 
the  algorithm  offered  herein,  then  a  correlation  would  be  expected  between  velocity 
sensitivity  to  a  single  moving  edge  or  line  and  spatial  period  sensitivity.  Cells  that 
responded  better  to  larger  spatial  periods  should  also  respond  better  to  faster  moving 
lines. 

The  dependence  of  the  complex  elements  on  the  activity  of  simple  elements  may  be  a 
requirement  that  is  avoided  by  biological  systems.  Evidence,  sumraiirized  by  Wilson  et  al. 
(1990),  suggests  that  the  complex  cells  are  organized  in  parallel  with  the  simple  cells.  Yet 
other  evidence  that  the  component  contributing  receptive  fields  of  a  complex  cell  behave 
like  those  of  simple  cells  (Movshon  et  al.,  1978;  Heggelund,  1985)  is  a  compelling 
argument  for  the  conservative  u.se  of  the  simple  element’s  output  to  provide  orientation 
selectivity  for  the  complex  element. 

The  complex  elements  provide  information  that  may  be  predictive.  Because  both  spatial 
frequency  and  direction  participate  in  the  activation  of  a  complex  element,  the  complex 
element  can  predict  or  anticipate  the  next  location  (or  appearance)  of  a  moving  feature. 
This  capability  could  be  useful  in  .solving  problems  in  perceptual  invariance  under 
dynamic  conditions  (which  tire  by  far  the  most  commonly  met  with  in  the  real  world  of  a 
behaving  system). 
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SYMBOLS 


Symbol 


Description 


RXO  retinal  sustained  off-center  element 

RXI  retinal  sustained  on-center  element 

RYO  retinal  transient  off-center  element 

RYl  retinal  transient  on-center  element 


LGN 


lateral  geniculate  nucleus  of  the  thalamus 


TXO 

TXl 

TYO 

TYl 

IXO 

IXOb 


thalamic  sustained  principal  off-center  element 

thalamic  sustained  principal  on -center  element 

thalamic  transient  principal  off-center  element 

thalamic  transient  principal  on-center  element 

thalamic  sustained  inhibitory  off-center  element 

thalamic  sustained  inhibitory  off-center  input  buffer  element 


superior  colliculus  saccade  signal 


4Ca. 

4C^ 

4Bv 

4Bh 

4Bdr 

4Bd-^ 

5Ar 

5Al 

5Ad 

5Au 

3Br 

3Bl 

3Bd 

3Bu 

3Bru 

3Bld 

3Brd 

3Blu 


cortical  sustained  input  element 
cortical  transient  input  element 
cortical  vertical  simple  line  detector  element 
cortical  horizontal  simple  line  detector  element 

cortical  diagonal  (negative  slope)  simple  line  detector 

cortical  diagonal  (positive  slope)  simple  line  detector 

cortical  right  motion  detector  element 

cortical  left  motion  detector  element 

cortical  down  motion  detector  element 

cortical  up  motion  detector  element 

cortical  right  motion  complex  element 

cortical  left  motion  complex  element 

cortical  down  motion  complex  element 

cortical  up  motion  complex  element 

cortical  diagonal  (north-east)  motion  compl.x  element 

cortical  diagonal  (south-west)  motion  complex  element 

cortical  diagonal  (south-east)  motion  complex  element 

cortical  diagonal  (nonh-west)  motion  complex,  element 
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